

IMAGE MONITOR APPARATUS CONTROLLING CAMERA AND ILLUMINATION 
IN ORDER TO OPTIMIZE LUMINANCE OF PICKED-UP IMAGE 

BACKGROUND OF THE INVENTION 

5 

1) Field of the Invention 



apparatus which controls a camera and a lighting system. 



10 2) Description of the Related Art 



plurality of images picked up by a plurality of cameras in a 
plurality of locations are monitored in a monitoring center 
in a centralized manner. In addition, needs for monitoring 

15 or surveillance of a wide area, for example, an area 
including roads and railroads, are growing. Further, when 
the monitoring is performed in the nighttime, a high- 
sensitivity camera and a lighting system are required in 
order to monitor a dark area. 

20 In the conventional image monitoring system using a 

high- sensitivity camera and a lighting system, when a 
flashlight or car lighting is directed to the high- 
sensitivity camera, the entire screen may be whited out 
(i.e., the so-called screen white-out occurs), or blooming 

25 or smearing may occur. However, if the iris opening is 
narrowed, the effect of the illumination by the lighting 
system decreases, and the image picked up by the camera 



The present invention relates to an image monitor 



Recently, 



in many image monitoring systems, a 
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becomes dark except that an image portion produced by 
picking up the above external lighting is bright. 

As described above, the high- sensitivity camera is 
more susceptible to a disturbance caused in an image picked 
5 up by the high- sensitivity camera, than the cameras having 
normal sensitivity, where the disturbance is caused by, for 
example, light incident on the camera. Therefore, in order 
to obtain a stable image for monitoring, the disturbance 
must be appropriately controlled. 

10 

SUMMARY OF THE INVENTION 

An object of the present invention is to provide an 
image monitor apparatus which can suppress disturbances in 
picked-up images, and enables high-quality image monitoring. 

15 According to the present invention, there is 

provided an image monitor apparatus for monitoring an image. 
The image monitor apparatus comprises a camera, an 
illumination unit, and a processing unit. The camera picks 
up an image. The illumination unit includes a light emission 

20 unit and an emission control unit. The light emission unit 
includes at least one light emitting element, and the 
emission control unit controls the at least one light 
emitting element. The processing unit includes an image 
signal acquiring unit, a luminance examining unit, and a 

25 luminance control unit. The image signal acquiring unit 
performs analog- to -digital conversion of the image picked up 
by the camera so as to generate a digitized image signal. 
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and stores the digitized image signal. The luminance 
examining unit examines luminance of the image represented 
by the digitized image signal, and determines whether or not 
the amount of light detected by the camera and stored in an 
5 image-pickup plane of the camera is appropriate for 
suppressing disturbances in the image. The luminance control 
unit controls at least one of the camera and the 
illumination unit so that the amount of light becomes 
appropriate for suppressing disturbances in the image, when 

10 the luminance examining unit determines that the current 
amount of light detected by the camera and stored in the 
image-pickup plane is not appropriate for suppressing 
disturbances in the image. 

The image monitor apparatus according to the 

15 present invention may also have one or any possible 
combination of the following additional features (i) to (iv). 

(i) The luminance control unit may make feedback 
control of the camera so that a shutter speed of the camera 
is increased within such a range that a duration in which a 

20 shutter of the camera is open is not shorter than a duration 
of illumination by the illumination unit, and an iris 
opening of the camera is maximized. 

(ii) In the image monitor apparatus having the 
feature (i), when the amount of light cannot become 

25 appropriate for suppressing disturbances in the image even 
when the shutter speed of the camera is increased by the 
feedback control to the duration of illumination by the 
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illumination unit, the luminance control unit may increase 
the amount of light emitted by the illumination unit, and 
reduce the size of the iris opening. 

(iii) The luminance control unit may control the 
5 illumination unit so that the at least one light emitting 

element emits only when an image of a frame which is 
necessary for image processing is picked up by the camera. 

(iv) The luminance control unit may 
automatically detect blooming or smearing in the image based 

10 on the luminance of the image. 

According to the present invention, a stable image 
in which disturbance is suppressed can be obtained for 
monitoring. Therefore, it is possible to perform reliable, 
high-quality image monitoring. 

15 The above and other objects, features and 

advantages of the present invention will become apparent 
from the following description when taken in conjunction 
with the accompanying drawings which illustrate preferred 
embodiment of the present invention by way of example. 

20 

BRIEF DESCRIPTION OF THE DRAWINGS 
In the drawings : 

Fig. 1 is a diagram illustrating a basic 
construction of an image monitor apparatus according to the 
25 present invention; 

Fig. 2 is a diagram illustrating a portion of an 
example of the light emission unit; 
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Fig. 3 is a flow diagram illustrating an overall 
operation performed in an image monitor apparatus as a first 
embodiment of the present invention; 

Fig, 4 is a timing diagram illustrating examples of 
5 operations performed in the first embodiment of the present 
invention; 

Fig. 5 is a timing diagram illustrating examples of 
operations performed in a second embodiment of the present 
invention; 

^ 10 Fig. 6 is a timing diagram illustrating examples of 

operations performed in a third embodiment of the present 
^ invention; 

W Fig. 7 is a flow diagram illustrating a sequence of 

5 _ operations for detecting blooming; and 

U 15 Fig. 8 is a diagram illustrating an example of a 

?o portion of an image which includes blooming. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Embodiments of the present invention are explained 
20 below with reference to drawings. 

(1) Construction of Image Monitor Apparatus 

Fig. 1 is a diagram illustrating a basic 
construction of an image monitor apparatus according to the 
25 present invention. As illustrated in Fig. 1, the image 
monitor apparatus 1 according to the present invention 
comprises a (high-sensitivity) camera 10, an illumination 
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unit 20, and a processing unit 30. The camera 10 picks up an 
image of an object, and generates an (analog) image signal 
representing the image. For example, the image signal is in 
accordance with the NTSC or PAL standard. Alternatively, the 
5 image signal can be in accordance with any other standard. 
The illumination unit 20 illuminates the object, for example, 
in the nighttime, and comprises a light emission unit 21 and 
an emission control unit 22. The light emission unit 21 
comprises at least one light emitting element which emits 
10 light for illumination of the object. The emission control 
unit 22 controls the light emission by the light emission 
unit 21, for example, as explained later with reference to 
Fig. 2. 

The processing unit 30 controls the camera 10 and 
15 the illumination unit 20, and processes the image signal 
generated by the camera 10. The processing unit 30 comprises 
an image signal acquiring unit 31, a luminance examining 
unit 32, a luminance control unit 33, and an image 
processing unit 34. The image signal acquiring unit 31 
20 comprises an A/D conversion unit 31a and an image memory 31b. 
The A/D conversion unit 31a receives the analog image signal 
from the camera 10, and converts the analog image signal 
into a digitized image signal by performing A/D conversion 
for each field corresponding to 1/60 seconds. The image 
25 memory 31b stores the digitized image signal. The image 
processing unit 34 reads out the image signal from the image 
memory 31b, and processes the image signal. For example, the 
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image processing unit 34 performs processing for person 
recognition. In this case, the image processing unit 34 
sends information on the recognized person to a monitoring 
center, as well as the image signal. 
5 The luminance examining unit 32 reads out the image 

signal stored in the image memory 31b, and determines 
whether or not the luminance of the image represented by the 
image signal is appropriate for suppressing disturbances in 
the image picked up by the camera 10, or preferably whether 

10 or not the luminance of the image represented by the image 
signal is optimum for suppressing disturbances in the image 
picked up by the camera 10. Thus, the luminance examining 
unit 32 can determine whether or not the amount of light 
detected by the camera 10 and stored in the image-pickup 

15 plane of the camera 10 is appropriate (or optimum). When the 
luminance examining unit 32 determines that the amount of 
light detected and stored in an image-pickup plane is not 
appropriate (or optimum) for suppressing disturbances in the 
image picked up by the camera 10, the luminance control unit 

20 33 controls at least one of the camera 10 and the 
illumination unit 20 so that the above amount of light 
becomes appropriate (or optimum) for suppressing 
disturbances in the image picked up by the camera 10. 
Details of the operations of the luminance control unit 33 

25 are explained later with reference to Fig. 3. 

Fig. 2 is a diagram illustrating a portion of an 
example of the light emission unit 21. The light emission 
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unit 21 illustrated in Fig. 2 comprises a plurality of light 
emitting elements, which are arranged in a plurality of rows. 
In Fig. 2, the odd-numbered rows are denoted by "A", and the 
even-numbered rows are denoted by "B" . The emission control 
5 unit 22 controls the light emission of the plurality of 
light emitting elements in the light emission unit 21. For 
example, light emitting elements in the row "A" and the 
light emitting elements in the row "B" are alternately 
activated under the control of the emission control unit 22. 

10 Alternatively, all of the light emitting elements in the 
light emission unit 21 may be activated concurrently. In 
addition, the emission control unit 22 controls the light 
emission unit 21 so that the timing of the activation (i.e. , 
emission) of the light emitting elements in the light 

15 emission unit 21 is synchronized with the image acquisition 
timing of the camera 10. 



(2) Overall Operation of Image Monitor Apparatus 

Fig. 3 is a flow diagram illustrating an overall 
20 operation performed in the image monitor apparatus as the 

first embodiment of the present invention. 

In step SI, the luminance control unit 33 makes an 

initial setting of the high-sensitivity camera 10. 

Specifically, the shutter speed of the high- sensitivity 
25 camera 10 is set to the slowest (longest) possible value in 

order to efficiently utilize external illumination (such as 

ambient light and moonlight) when the illumination unit 20 
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does not emit light- In addition, the iris of the high- 
sensitivity camera 10 is set to an auto iris setting so that 
the high- sensitivity camera 10 automatically picks up an 
optimum image under available illumination. 
5 In step S2, the luminance control unit 33 makes an 

initial setting of the illumination unit 20. Specifically, 
the duration of illumination (or flash duration) is set to 
the shortest time which can provide a sufficient amount of 
light for image processing, in order to lengthen the life of 
;S 10 each light emitting element. 

!jf In step S3, after the above initial setting, the 

^ high- sensitivity camera 10 picks up an image. The image 

4: signal acquiring unit 31 makes the A/D conversion of the 

" picked-up image, and stores the digitized image signal in 

W 15 the image memory 31b. 

=0 In step S4, the luminance examining unit 32 

{=2= determines whether or not the luminance of the image 

represented by the digitized image signal stored in the 
image memory 31b is appropriate for suppressing disturbances 
20 in the image. For example, as mentioned before, when a 
flashlight or car lighting is directed to the high- 
sensitivity camera 10, an excessive amount of light is 
stored in the image-pickup plane of the high- sensitivity 
camera 10 due to the strong light, and the entire screen may 
25 be whited out, or blooming or smearing may occur. 

For example, in the case of NTSC signals, when the 
luminance value at coordinates (i,j) is expressed by y(i,j). 
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and the sum total of luminance values of all pixels in an 
image is expressed by Y, the sum total Y of luminance values 
in each field of an NTSC signal is expressed as 

640 240 
i-l j=l 

5 When the sum total Y of luminance values in a field 

is greater than a threshold value which is preset , it is 
considered that the entire screen is whited out (i.e., all 
pixels have very high luminance values). Therefore, in this 
case, the luminance examining unit 32 determines that the 

10 influence of external lighting is great, and the operation 
goes to step S5 . When the sum total Y of luminance values in 
a field is smaller than the threshold value, the luminance 
examining unit 32 determines that the luminance of the image 
is appropriate for the image processing, and the operation 

15 goes to step S6 . 

In step S5, the luminance control unit 33 resets 
the high-sensitivity camera 10 based on the determination 
made by the luminance examining unit 32. First, the size of 
the iris opening is maximized so that the illumination by 

20 the illumination unit 20 can be most efficiently utilized. 
Next, in order to reduce the influence of the external 
lighting, the shutter speed is increased, i.e., the duration 
in which the high- sensitivity camera 10 detects light and 
stores the amount of detected light for each pixel in each 

25 field is shortened. Thus, it becomes possible to suppress 
contribution of the external lighting to the amount of light 
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detected by the high- sensitivity camera 10 and stored in the 
image-pickup plane, and maximize the utilization of the 
illumination by the illumination unit 20. 

When the resetting operation of the high- 
5 sensitivity camera 10 is completed, the operation goes back 
to step S3, and the high- sensitivity camera 10 performs an 
operation of picking up the next image. Then, in step S4, 
the luminance examining unit 32 determines again whether or 
not the luminance of the next image is appropriate for image 

10 processing. When the luminance examining unit 32 determines 
that the influence of the external lighting is still great, 
the luminance control unit 33 further increases the shutter 
speed while maintaining the maximized iris opening. However, 
if the shutter speed falls below the duration of the 

15 illumination by the illumination unit 20, the illumination 
by the illumination unit 20 is not effectively utilized, and 
the image may become dark except that an image portion 
produced by picking up the external lighting is bright. 
Therefore, when the shutter speed reaches the duration of 

20 the illumination by the illumination unit 20, the shutter 
speed is maintained at the duration of the illumination by 
the illumination unit 20. The above feedback operations in 
the loop of steps S3, S4, and S5 are repeated until the 
luminance examining unit 32 determines that the influence of 

25 the external lighting is not great, i.e., the luminance of 
the image is appropriate for image processing. 

In step S6 , the image processing unit 34 performs 
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image processing of the image signal of which the luminance 
is determined to be appropriate. Since the setting of the 
high- sensitivity camera 10 is optimized in the above 
feedback control as preprocessing, it is possible to obtain 
5 an appropriate image signal, and perform appropriate image 
processing. 

In step S7, the luminance control unit 33 
determines whether or not a predetermined time has elapsed 
since the time of the resetting of the high- sensitivity 
~ 10 camera 10. When the predetermined time has not elapsed, or 
w when the resetting has not been made, the operation goes 

H back to step S3. When the luminance control unit 33 

W determines that the predetermined time has elapsed, it is 

v. assumed that the disturbance (such as the car lighting 

jjj 15 directed to the high- sensitivity camera 10) is eliminated. 

:Q Therefore, the operation goes back to step SI, and the 

O 

initial setting of the high- sensitivity camera 10 is made 
again . 

20 (3) Timing of Luminance Control 

Fig. 4 is a timing diagram illustrating examples of 
operations performed in the first embodiment of the present 
invention. In this example, it is assumed that only the odd- 
numbered fields Fl or only the even-numbered fields F2 are 

25 used for image processing. In the initial setting, an image 
pickup period is set to 1/60 seconds, the duration of 
illumination is set to 1/480 seconds, the intensity of the 
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illumination is set to a value which is realized by 
alternately activating the light emitting elements in the 
rows A and B (illustrated in Fig. 2), the shutter speed is 
1/60 seconds, and the iris is set to the auto iris setting. 
5 When the luminance examining unit 32 determines 

that the influence of the external lighting is great, the 
size of the iris opening is reset to F M i N , which indicates 
that the size of the iris opening is maximized, and the 
shutter speed is increased (shortened) to 1/120 seconds. The 

10 other settings are the same as the initial settings. 

Thereafter, the determination whether or not the 
influence of the external lighting is great, and the 
increase (shortening) of the shutter speed are repeated 
until the shutter speed reaches the duration of the 

15 illumination, 1/480 seconds. In each operation of increasing 
the shutter speed, the shutter speed is doubled, i.e. , the 
duration in which the shutter is open is reduced by half. 
However, if the shutter speed falls below the duration of 
the illumination by the illumination unit 20, the 

20 illumination by the illumination unit 20 is not effectively 
utilized, and the image may become dark except that an image 
portion produced by picking up the external lighting is 
bright. Therefore, when the shutter speed reaches the 
duration of the illumination, 1/480 seconds, the above 

25 feedback operations are completed, and an image picked up by 
the high- sensitivity camera 10 with the shutter speed of 
1/480 seconds is used in the image processing. 
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As explained above, in the first embodiment of the 
present invention, contribution of the external lighting to 
the amount of light stored in the image-pickup plane can be 
suppressed by feedback control of the shutter speed. In 
5 addition, it is possible to maximize the utilization of the 
illumination by the illumination unit 20 for image 
monitoring. 

( 4 ) Second Embodiment 

10 The feedback control in the second embodiment of 

the present invention is explained below. 

In the second embodiment , when the luminance 
examining unit 32 determines that the influence of the 
external lighting is still great even after the shutter 

15 speed is increased (shortened) to the duration of the 
illumination by the illumination unit 20 by the feedback 
control made in the first embodiment, the image monitor 
apparatus further makes feedback control of the intensity of 
the illumination by the illumination unit 20 and the size of 

20 the iris opening. That is, when the luminance examining unit 
32 determines that the influence of the external lighting is 
great , the intensity of the illumination by the illumination 
unit 20 is increased, and the size of the iris opening is 
adjusted corresponding to the increase in the intensity of 

25 the illumination. 

Specifically, when the luminance examining unit 32 
determines that the influence of the external lighting is 
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great, the luminance control unit 33 sends to the emission 
control unit 22 an instruction to increase the number of 
light emitting elements which are concurrently activated. In 
accordance with the instruction, the emission control unit 
5 22 controls the light emission unit 21 so as to increase the 
number of light emitting elements. In addition, the 
luminance control unit 33 sends to the high- sensitivity 
camera 10 an instruction to reduce the size of the iris 
opening corresponding to the increase in the intensity of 

10 the illumination, so that contribution of the illumination 
by the illumination unit 20 to the light level at the high- 
sensitivity camera 10 is maintained equivalent to that in 
the first embodiment. In accordance with the instruction, 
the high- sensitivity camera 10 reduces the size of the iris 

15 opening. The above feedback control of the intensity of the 
illumination by the illumination unit 20 and the size of the 
iris opening is repeated until the luminance examining unit 
32 determines that the influence of the external lighting is 
not great . When the influence of the external lighting is 

20 eliminated by the feedback control, the image monitoring is 
performed. Thereafter, when a predetermined time elapses 
since the above feedback control is completed, it is assumed 
that the disturbance such as the influence of the external 
lighting is eliminated, and the initial setting of the high- 

25 sensitivity camera 10 and the illumination unit 20 is made 
again . 

When the disturbance such as the influence of the 
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external lighting is eliminated, the above increase in the 
intensity of the illumination is unnecessary. Therefore, it 
is possible to efficiently use the light emitting elements 
by initializing the high- sensitivity camera 10 and the 
illumination unit 20 when a predetermined time elapses since 
the above feedback control is completed. Thus, the life of 
each light emitting element can be lengthened. 

Fig. 5 is a timing diagram illustrating examples of 
operations performed in the second embodiment of the present 
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When the luminance examining unit 32 determines 
that the influence of the external lighting is still great 
after the feedback control in the first embodiment, the 
luminance control unit 33 controls the illumination unit 20 

15 so as to concurrently activate the light emitting elements 
in both of the rows A and B, and resets the high- sensitivity 
camera 10 so as to reduce the size of the iris opening by 
half to Fmin/2. In the example of Fig. 5, the shutter speed 
is set to 1/480 seconds as a result of the feedback control 

20 in the first embodiment. 

As explained above , in the second embodiment , the 
intensity of the illumination by the illumination unit 20 
and the iris opening in the high- sensitivity camera 10 are 
controlled, after the control of the shutter speed in the 

25 first embodiment, so as to suppress the disturbance in the 
image picked up by the high- sensitivity camera 10. 
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( 5 ) Third Embodiment 

The feedback control in the third embodiment of the 
present invention is explained below . 

In image monitoring, sometimes, it is not necessary 
5 to perform image processing of an image of every frame. 
Therefore, for example, if image processing is performed on 
an image of every two or three frames, illumination by the 
illumination unit 20 is unnecessary for the skipped frames. 
Therefore, in the third embodiment, the illumination unit 20 
*z 10 is controlled so as to activate the light emitting elements 
Jrf only when an image of a frame which is necessary for image 

l= Z processing is picked up. 

w Fig. 6 is a timing diagram illustrating examples of 

* operations performed in the third embodiment of the present 

-Zl 

U 15 invention. In the example of Fig. 6, the image pickup period 
hQ is 1/30 seconds, and the illumination timing is set so that 

§ - 

1^ the illumination by the illumination unit 20 synchronizes 

with the image pickup timing. In addition, the size of the 
iris opening is reduced by half to Fmin 

/2, and the light 

20 emitting elements in both of the rows A and B are 
concurrently activated. 



(6) Automatic Recognition of Blooming 

Automatic recognition (detection) of blooming is 
25 explained below. 

Sometimes, external lighting causes blooming as 
well as the screen white-out. The blooming is halation or 
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defocus which occurs around bright areas produced in an 
image by picking up a very bright object such as external 
lighting. The luminance examining unit 32 can automatically 
detect the blooming, and the luminance control unit 33 makes 
5 feedback control until the blooming disappears. The 
characteristic of the blooming is that white (bright) pixels 
are distributed around a point corresponding to a light 
source, and form a bright round area, and the brightness of 
the pixels around the bright round area gradually decreases 
5 10 so that the area around the bright round area is blurred, 
jjj Therefore, in order to detect the blooming, the bright area 

H; is first extracted, and it is then determined whether or not 

- is 

W an area around the bright area is blurred. However, in the 

above operation of extracting the bright area, small bright 

O 

hi 15 areas which are considered not to affect the image 
iO processing are ignored. In addition, bright areas which are 

{1 not surrounded by blurred areas are each recognized to be a 

bright object instead of blooming. 

Fig. 7 is a flow diagram illustrating a sequence of 
20 operations for detecting blooming. 

A threshold value C used for determining the above 
bright area and another threshold value D used for 
determining the above blurred area are set in advance in the 
image monitor apparatus 1 . 
25 In step S10, the luminance examining unit 32 

performs processing for binalizing all pixels of an image 
picked up by the high- sensitivity camera 10 by using the 
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threshold value C. That is, pixel values equal to or greater 
than the threshold value C are converted to one, and pixel 
values smaller than the threshold value C are converted to 
zero . 

5 In step Sll, the luminance examining unit 32 

performs processing for labelling the binalized image, and 
extracts as at least one object at least one aggregation of 
pixels having the value "one", where the labelling is an 
operation of assigning a label (number) to each pixel of a 

'2 10 binalized image in order to extract at least one object 

{ p included in the image, 

1=^ In step S12, the luminance examining unit 32 

yj discards at least one object which has an area smaller than 

a predetermined value S, from among the at least one object 
yj 15 extracted in step Sll. 

[q In step S13, the luminance examining unit 32 

determines whether or not at least one extracted object 
exists after the discard in step S12. When yes is determined, 
the operation goes to step SI 4. When no is determined, the 

20 operation goes to step S17. 

In step S14, the luminance examining unit 32 counts 
the number of pixels having a value equal to or greater than 
the threshold value D and smaller than the threshold value C 
in an area surrounding each of the at least one extracted 

25 object, where the surrounding area has a loop shape having a 
width of N pixels in each of the vertical and horizontal 
directions. Then, the luminance examining unit 32 calculates 
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the ratio between the counted number and the total number of 

pixels in the surrounding area. 

In step S15, the luminance examining unit 32 

compares the ratio calculated in step S14 with a 
5 predetermined value P(%). When the ratio calculated in step 

S14 is equal to or greater than the predetermined value P, 

the operation goes to step S16. When the ratio calculated in 

step S14 is smaller than the predetermined value P, the 

operation goes back to step S13. 
E3 10 In step S16, the luminance examining unit 32 

|3 recognizes the extracted object as blooming. 

H In step S17, the luminance examining unit 32 

W recognizes that no blooming exists in the image. 

Fig. 8 is a diagram illustrating an example of a 
LlJ 15 portion of an image which includes blooming. In the example 
[q of Fig. 8 # high- luminance pixels (i.e., pixels having a 

l2 value equal to or greater than the threshold value C) are 

indicated with blank circles, middle -luminance pixels (i.e., 
pixels having a value equal to or greater than the threshold 
20 value D and smaller than the threshold value C) are 
indicated with grey circles, and the other pixels including 
low- luminance pixels (i.e., pixels having a value smaller 
than the threshold value D) are indicated with black circles. 

First, each aggregation of high- luminance pixels, 
25 which are encircled by solid lines in Fig. 8, is examined. 
When the above-mentioned predetermined area S is ten 
(pixels), the aggregation Rl , which is indicated in the 
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upper right portion of Fig. 8, is regarded as noise, and 
discarded. Next, the area surrounding the aggregation R2 and 
having a loop shape with a width of two pixels in each of 
the vertical and horizontal directions, which is encircled 
5 by dashed lines in Fig. 8, is examined. In this example, the 
number of the pixels in the surrounding area is twenty-eight, 
and twenty-five pixels among the twenty-eight pixels are 
middle -luminance pixels. Therefore, the ratio between the 
number of middle -luminance pixels and the total number of 

0 10 pixels in the surrounding area is obtained as (25/28) X 100 
tO =89%. Then, the obtained ratio is compared with the 
M* predetermined value P(%) in order to determine whether or 
lij not the aggregation R2 constitutes blooming. For example, 

when the predetermined value P is 80(%), the luminance 

G 

hj 15 examining unit 32 determines that the aggregation R2 

1 y 

.n constitutes blooming. 

B 

(7) Automatic Recognition of Smear 

Automatic recognition (detection) of a smear is 

20 explained below. 

Sometimes, external lighting also causes a smear in 
an image picked up by the high-sensitivity camera 10. The 
smear is a vertical streak which appears above and below 
bright areas produced in an image by picking up a very 

25 bright object such as the external lighting. The luminance 
examining unit 32 can automatically detect the smear, and 
the luminance control unit 33 makes feedback control until 
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the smear disappears . The characteristic of the smear is 
that white (bright) pixels are distributed above and below a 
point corresponding to a light source, and form a bright 
vertical streak. Therefore, in order to detect a smear, the 
5 sum total of luminance values of pixels on each vertical 
line is calculated, and it is determined whether or not a 
smear exists on the line, based on the sum total of the 
luminance values . 

For example, in the case of NTSC signals, when the 
2 10 luminance value at coordinates (i,j) is expressed by y(i,j), 

and the sum total of luminance values of all pixels on each 
%I vertical line in an image is expressed by Y' , the sum total 

Y ' is expressed as 



= Jj Y(i. 3) (2) 



15 When the sum total Y f of luminance values on each 

vertical line is greater than a predetermined threshold 
value A, it is considered that a bright line exists on the 
vertical line, i.e. , it is determined that a smear exists on 
the vertical line. When the sum total Y' is not greater than 

20 the predetermined threshold value A, it is determined that a 
smear does not exist on the vertical line. The above 
determination is made on all of the vertical lines in an 
image. In the case of the NTSC signals, the number of the 
vertical lines is 640. When all of the vertical lines in the 

25 image are determined not to include a smear, it is 
determined that no smear exists in the image. 
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(8) Advantages and Other Matters 

(i) As explained above, the image monitor apparatus 
1 according to the present invention determines whether or 

5 not the amount of light detected by the high-sensitivity 
camera 10 and stored in the image-pickup plane of the high- 
sensitivity camera 10 is appropriate (or optimum) for 
suppressing disturbances in the image, based on the 
luminance values of the image signal. When it is determined 
'5 10 that the amount of light is not appropriate, feedback 
control of at least one of the high- sensitivity camera 10 
and the illumination unit 20 is made. Therefore, it is 
possible to suppress the influence of light from the 
external light source in the high- sensitivity camera 10, and 
15 obtain a stable image by using the high- sensitivity camera 
10. In addition, since the duration and the intensity of 
illumination by the illumination unit 20 are controlled so 
that the light emitting elements are efficiently used, it is 
possible to lengthen the life of each light emitting element 
20 in the illumination unit 20, and perform efficient image 
monitoring . 

(ii) The foregoing is considered as illustrative 
only of the principle of the present invention. Further, 
since numerous modifications and changes will readily occur 

25 to those skilled in the art, it is not desired to limit the 
invention to the exact construction and applications shown 
and described, and accordingly, all suitable modifications 
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and equivalents may be regarded as falling within the scope 
of the invention in the appended claims and their 
equivalents . 

(iii) All of the contents of the Japanese patent 
5 application. No . 2000-311106 are incorporated into this 
specification by reference. 




- 24 - 



